Add Qwen3 235B A22B Instruct 2507 model for Vertex AI #388
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: addc493296
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
| "max_input_tokens": 262144, | ||
| "max_output_tokens": 16384 | ||
| }, | ||
| "publishers/qwen/models/qwen3-235b-a22b-instruct-2507-maas": { |
There was a problem hiding this comment.
This model is registered as format: "openai" on Vertex, so calls will go through fetchOpenAI, but that function only routes publishers/meta/... models to .../endpoints/openapi/chat/completions and sends all other publishers to :rawPredict after rewriting the model name. Because this new entry is another *-maas model (publishers/qwen/...-maas), it will follow the non-Meta branch and be invoked with the wrong Vertex path/model rewrite for chat-completions requests, causing runtime request failures for users selecting this model.
Useful? React with 👍 / 👎.
1 participant
Adding model Qwen3 235B A22B Instruct 2507 model for Vertex AI using details in: https://docs.cloud.google.com/vertex-ai/generative-ai/docs/maas/qwen/qwen3-235b